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The aim of this handout is to provide a mathematically complete treatise 
on Lagrange Multipliers and how to apply them on optimization problems. 
The ideas here are presented logically rather than pedagogically, so it may 
be beneficial to read the examples before the formal statements. 


Lagrange multipliers offer a way to find the extrema of an objective function 
f(x1,22,...,2%n) subject to a constraint function g(71,22,...,2%,) = 0; for example, 
we may wish to maximize a+ b+ ¢ subject to a? +0? +c? = 1. 

However, there are lots of tiny details that need to be checked in order to completely 
solve a problem with Lagrange multipliers. On an olympiad the use of Lagrange multi- 
pliers is almost certain to draw the wrath of graders, so it is imperative that all these 
details are done correctly. 


1 Analysis Preliminaries 


First, we need to define several terms. Let R denote the set of real numbers, and let R” 
denote the set of n-tuples of real numbers; that is, n-dimensional Euclidean space. 


Definition 1.1. A neighborhood of a point p € R” is some set of points of the form 
{x € R” | d(x,p) < e} 
where d(x, y) denotes the distance between two points, and ¢ is a positive real number. 


In other words, a neighborhood is just a “sphere” with nonzero radius ¢. Now, we 
need to introduce some definitions from real analysis. 


Definition 1.2. A subset S of R” is open in R” if for every point p € S, there exists a 
neighborhood of p completely contained inside S. 


Figure 1: The open disk D is open. 
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Example. In R?, the open disk 
D={(z,y)|2*+y? <1} 


is open because for every point p inside it, we can find a small neighborhood completely 
inside the disk. See Figure [I] noting that D does not contain its “boundary”. 
Similarly, the open interval (0,1) is open in R. 


Definition 1.3. A subset S of R” is closed in R” if the following holds: if x1, ro, ..., 
is a sequence of points in S' which converges to some limit x, then x € S. 
An equivalent definition is that IR” \ S should be open. 


Example 1.4. The closed disk D = {(x,y) Jar? ty? < 1} is closed. Similarly, the 
closed interval [0,1] is closed in R (meaning: if a convergent sequence of reals is between 
0 and 1 inclusive, then it must converge to a real number between 0 and 1 inclusive). 


And now you know why open and closed intervals are so called! Note that most sets 
are neither open nor closed in R”, and some sets are both open and closed (such as @, 
the empty set, as well as the entire R”). 


Remark. Up to now we have been kosher in saying that a set S is closed in R”, this is 
important because a set is only open or closed relative to its parent. However, we will 
henceforth drop the clause “in R”” for brevity. 


To aid with constructing closed and open sets, we have the following nice statements. 


Proposition 1.5. Let S and T be sets in R”. If S and T are both open (resp. closed), 
then SUT and SMT are also both open (resp. closed). 


Proposition 1.6. Let S C R™ and T CR”. If S and T are both open (resp. closed), 
then S x T is open (resp. closed) in R™™. 


You may also have noticed by now that open and closed sets seem to differ by a 
“boundary”. We can formalize this with the notion of a closure. 


Definition 1.7. Given a set U, the closure of U is the smallest closed set containing 
U. 


One can prove that U is closed. I’ve cheated here with the notion of “smallest”; one 
can prove that “smallest by inclusion” works out. In practice, for R” this just means 
e.g. adding in the boundary points back into an open set. 

Finally, we need one other notion, called compactness. 


Definition 1.8. A subset S of R” is bounded if it can be contained inside an n-sphere 
of finite radius. If it is also closed, we say S is compact. 


The actual definition of compactness is that given any arbitrary sequence in S, we can 
find a sub-sequence which converges. However, in the special case where S C R”, these 
are equivalent. 


Example 1.9. Consider a rectangular box B = [0,1] x [0,2] x [0,3] in R?. We can see 
that it is both closed and bounded, so it is compact. 
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2 Lagrange Multipliers 
We can give the statement of the theorem of Lagrange Multipliers. 


Theorem 2.1 (Lagrange Multipliers). Let U be an open subset of R", and let f: U +R 
andg:U +R be continuous functions with continuous first derivatives. Define the 
constraint set 

S={xeU | g(x) =c} 


for some real number c. 

Suppose x € S is a local maximum of f, meaning for some neighborhood around x the 
point x gives the maximal value of all points in S. Then either Vg(x) = 0 at this point, 
or for some real number 4X, 


V f(x) = AVg(x). 


(Note that we only discuss maximums; to find minimums simply consider — f.) 

This is fine and well, but it does not tell us anything about the global maximum 
of f constrained to g. Indeed, such a global maximum may not even exist! That means 
there is still tons of work left to find the maximum value of f, if indeed it exists. 

The following two lemmas let us save face. 


Lemma 2.2. Let S be a compact set and f : U > R be a continuous function. Then f 
has a global maximum over S — there exists a point x € S such that f(x) > f(y) for 
any other pointy € S. 


Lemma 2.3. [fg : R” > R is a continuous function, then the set C = {x € R” | g(x) = c} 
is a closed set for any real number c. 


Hence, we can escape using the following method. Let’s take our function f:U 7 R 
with U open, and consider the closure U of U. Let’s instead optimize f : U > R", where 
U is the closure of U. Define 


G=]{x ER” | glx) —c}. 
Note that C is closed by our lemma. Also, define 
S=UNIG =e U | ox) =e} 


as well as 
S=UnNC={xeU | g(x) =c}. 


As the notation suggests, S is the closure of S', and in any case is clearly itself closed. If 
either of C or U is bounded, then so is S, meaning S is compact! When that occurs, f 
achieves a maximum x € 5S somewhere on the set CMU. 

We can then consider two cases. 


e Ifx ¢ U—U, that is, x lies in the “boundary”, then we can check this case 
manually. 


e If x € U, that is, x lies in the “interior”, then we can use Lagrange multipliers. 
After all, x is a global maximum, so it is certainly a local one as well. Here the 
constraint set is simply S= COU. 


This is the method of Lagrange multipliers. 
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3 Examples 


3.1 An Easy Example 
Example 3.1 (AM-GM). For positive reals a, b, c, prove that 


atb+c> 3vVabe. 


Solution. The first step is de-homogenizing the inequality to assume that a+ b+c=8, 
in which case we wish to prove abc < 1. Thus, define 


f(a, b,c) = abc 


and 
g(a,b,c) =at+b+t+e. 


Note that Vg = (1,1,1) 4 0 at all points, and moreover that f and g are continuous 
with continuous partial derivatives. 

We will let U = (0,3)°, U = [0,3]? (meaning we will actually prove the inequality for 
all a,b,c > 0). Note that U is bounded, so the constraint set 


is compact. Hence, it achieves a maximum value, say x. 

If x lies on the boundary, then at least one component of x is zero, whence abc = 0; 
this is clearly not a maximum. 

Otherwise, let x = (a,b,c). By Lagrange multipliers, we know 


Vf (a,b, ¢) = AVg(a, b, ¢) 


or 


(be, ca, ab) = A(1,1,1). 


That is, be = ca = ab = X. If A = 0, then a = b = c = O,7 and f is zero at such points. 
Otherwise, we conclude that a = b= c. Sincea+6+c = 3, we must havea =b=c=1. 
Hence f(1,1,1) =1. 

We find that the critical point yielding the largest value on S is (1,1,1), which gives 
f(1,1,1) =1. This must be a maximum, and hence f(a,b,c) < 1 for alla+b+c=83, 
0< a,b,c < 3, as desired. 


3.2 A Hard Example 


Now we try a much bloodier example. 


Example 3.2 (USAMO 2001/3). Let a, b, c be nonnegative reals with a?+b?+c?+abe = 
4. Prove that 
0<ab+bc+ca-— abe < 2. 


Solution. The left-hand side of the inequality is trivial; just note that min {a,b,c} < 1. 
Hence, we focus on the right side. We use Lagrange Multipliers. 
Define 
U = {(a,6,c) | a,b,c > 0 and C+P+e< 1000}. 


This is an intersection of open sets, so it is open. Its closure is 


U = {(a,b,c) | a,b,c > 0 and a’ +b? +c? < 1000}. 
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Hence the constraint set a _ 
S={xeU: g(a) =4} 
is compact, where g(a, b,c) = a? +b? + c? + abc. Excellent. 
Define 
f(a,bec =0+h +c? +ab+bc+ca. 


It’s equivalent to show that f < 6 subject to g. Over S, it must achieve a global 
maximum. Now we consider two cases. 

If x lies on the boundary, that means one of the components is zero (since a?+b?+c? = 
1000 is clearly impossible). WLOG c = 0, then we wish to show a? + b? + ab < 6 for 
a? + b? = 4, which is trivial. 

Now for the interior U, we may use the method of Lagrange Multipliers. Consider a 
local maximum x € U. Compute 


Vf = (2a+6+4+c¢,2b+c+a,2c+a+b) 


and 
Vg = (2a + bc, 2b + ca, 2c + ab) . 


Of course, Vg 4 0 everywhere, so introducing our multiplier yields 


(2a+b+c,at+2b+c¢,a+6+4 2c) = \ (2a + be, 2b + ca, 2c + ab). 


Note that 4 0 since a,b,c > 0. Subtracting 2a + b+ c= A(2a +4 bc) from a+ 2b+c= 
(2b + ca) implies that 
(a — b)({2A — 1] — Ac) = 0. 

We can derive similar equations for the others. Hence, we have three cases. 

Case 1: Ifa =b=c, thena=b=c =1, and this satisfies f(1,1,1) < 6. 

Case 2: If a, b, c are pairwise distinct, then we derive a = b = c = 2— 7, contradic- 
tion. 

Case 3: Now suppose that a=b#c. That means A = x (of course our conditions 
force c < 2). Now 


1 
2a + 2c =a+b+ 2c = A(2c + ab) = yw g(2e+) 
—c 
which implies 
4a + 4c — 2a? — 2ac = 2c + a? 
meaning (with the additional note that a 4 1) we have 
3a? — 4a 
c= ———_. 
2 — 2a 
Note that at this point, c > 0 forces 1<a< ‘. 
The constraint a? + 0? +c? +abe=4 6 c? + +a7e + (2a? — 4) = 0 now gives 
(3a? — 4a)” + a? (3a? — 4a) (2 — 2a) + (2a? — 4) (2- 2a)? = 0. 


Before expanding this, it is prudent to see if it has any rational roots. A quick inspection 
finds that a = 2 is such a root (precisely, 16 — 32 + 16 = 0). Now, we can expand and 
try to factor: 


0 = —6a° + 31a* — 48a? + 8a? + 32a — 16 
= (a — 2)(—6a* + 19a* — 10a” — 12a + 8) 
= (a — 2)? (—6a* + 7a” + 4a — 4) 
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Seeing a cubic, we desperately try every rational root and miraculously discover 
= (a — 2)*(2 — 3a)(2a7 — a — 2). 


The only root a in the interval (i, 4) isa= i (1 + V17). You can guess what comes 
next — write 


and 
1 
f(a,b,c) = 3a? + 2ac+¢ = 39 (121 + 17V 17) ; 


This is the last critical point, so we’re done once we check this is less than 6. This follows 
from the inequality 17° < (6 - 32 — 121)?; in fact, we actually have 


1 
5 (121 mn ivi?) ~ 5.97165. 


This completes the solution. 


3.3 A Non-Example 


The following is not actually an example because you get stuck at the end (and it turns 
out you must get stuck, as I explain), but I included it because of popular request. 


Example 3.3 (USAMO 2014/1). Let w, x, y, z be real numbers satisfying 
wetcytyzt+zxtwytez > 54+ wryz. 


Prove that 
(w* + 1)(x? + 1)(y? + 1)(2? +1) > 16. 


Non-Solution. By scaling appropriately, we can assume our condition is actually an 
equality. Moreover, we will only prove the inequality in the case where 


we t+a7?+y*%+27 < 1000 


since the conclusion is obvious otherwise. 
Define 


FUR B 2) = So In(w? +1) 


cyc 
and 
g(w,2@,y, 2) = wet xcytyzt ze+wyt+aez—wreyz-—5 


where we have 
U = {(w,2,y,z)|w? +a°+y? +2? < 1000} 


an open ball, whence 
U = {(w,2,y,2) | w? +2? +y? + 2? < 1000} 


is a closed ball, which is compact. 
First, we need to check that Vg 4 0. Compute 


Og 


BTS UT YT eZ — xyz. 
Ow 
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If it is the case that all of these are zero, we will derive a contradiction. This would imply 
that wx + wy + wz = waryz. Cyclically adding we get 2(5 + wxryz) = 4waxyz, whence 
wayz = 5. That means w(# + y+ z) = 5 so each of w, x, y, z are the nonzero roots of 
the quadratic t? — (w+a2+y+z)t+5 =0, and so they take on at most two distinct 
values. Now we consider a few cases. If w = x = y = z then from w(a +y +z) =5 we 
must have them all equal to +,/5/3, contradicting wryz = 5. Ife =y=z but w Fa, 
thenwt+aea=wt+aet+y+2>yt+2=0,s0 y = z =0 which is impossible. Finally, if 
w=axandy=zbutwFythenw+y = 2(w+y), whence w = —y. Now we can derive 
5 =w(2#+y+4+z) = —w?, which is impossible. So, Vg 4 0 everywhere. 

Now, the extrema on the boundary of U trivially satisfy the inequality, so we only 
need consider the interior. Evidently we have a \ with 


2 
ol = Mx+y+z—xryz). 
If \ = 0 then w = « = y = z = 0,7 which contradicts the given. Otherwise, 4 4 0 whence 
waeyz #0. If we lets =wt+at+ytzandd=wry+ cyz+ yzx + zxw then we can 
rearrange this as 


: =a (@+y+ ) 
~=[(—+w](ar Z— Lyz 
i ie ov] sv] 
aa see 1+w(et+yt 2) — wryz 
w 
ae (cy + yz + 2x) 
w 
2 4a Sa wey + wyz + wee + tyz) _s—d 
N — w ow 


Hence we have two cases. Either \ = $ and s = d, or 


_ s-d 
— 2/-4 


Ww=L=Y=z 


In the latter case, we obtain 6w? = w* + 5, which implies that the constant values are 
one of +1, +/5. Check that none of these cases give f(w, x,y,z) < 16. 
Otherwise, we derive that 


wtetytz=wryt+aryzt+yzwt+ zwe (1) 


AT this point we have used all the constraints. That means Lagrange Multipliers is telling 
us that any point (w, x,y,z) which also satisfies is possibly a local extrema; in other 
words, one can check that any x satisfying (1) and wr+ay+yz+ze+wytez = 5+wryz 
also satisfies V f(x) = AVg(x). 

Unfortunately, you can’t go farther than this because it turns out that is precisely 
the equality condition of the original problem. Boo. The end. 
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4 Practice Problems 
1. (USAMO 1978/1) Given that a, b, c, d, e are real numbers such that 
a+b+c+d+e=8 
CLP te te te = 16, 
determine the minimum value of e. 


2. (Mock Inequalities USAMO) Let a, b, c, d be nonnegative real numbers such that 
a+b+c+d=A. Prove that 3(a? + b? + c? + d?) + 4abcd > 16. 


3. (MOP 2012) Given that a+ b+c-+d= 4 for positive reals a, b, c, d, prove that 


Mg a a PE a De 
miptia >Satt+bt+et+d. 


4. (Canada 1999/5) Prove that for nonnegative real numbers a, b, c with a+b+c=1 
we have 


4 
2 2 2 
b+6 <—. 
a~b + ereas oF 


